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A METHOD OF AND SYSTEM FOR AUTOMATICALLY 
DETERMINING A LEVEL OF LIGHT FALLOFF IN AN IMAGE 

FIELD OF THE INVENTION 

5 The invention relates generally to the field of digital image 

processing, and in particular to a method of automatically determining a level of 
light falloff in an image. 



BACKGROUND OF THE INVENTION 

10 As described in many texts on the subject of optics (for example, 

M. Klein, Optics, John Wiley & Sons, Inc., New York, 1986, pp. 193-256, 
incorporated herein by reference) lenses produce non-uniform exposure at the 
focal plane when imaging a uniformly illuminated surface. When the lens is 
modeled as a thin lens, the ratio of the intensity of the light of the image at any 

15 point is described as cos 4 of the angle between the optical axis, the lens, and the 
point in the image plane. This cos 4 falloff does not include such factors as 
vignetting, which is a property describing the loss of light rays passing through an 
optical system. 

In photographic images, this cos 4 falloff generally causes the 
20 corners of an image to be darker than desired. The effect of the falloff is more 
severe for cameras or capture devices with a short focal length lens. In addition, 
flash photography will often produce an effect similar to falloff if the subject is 
centrally located with respect to the image. This effect is referred to as flash 
falloff 

25 As described in U.S. Patent 5,461,440 (incorporated herein by 

reference), it is commonly known that lens falloff may be corrected by applying 
an additive mask to an image in a log domain or a multiplicative mask to an image 
in the linear domain. This conventional cos 4 based mask is solely dependent upon 
a single parameter: the focal length of the imaging system. Also, images with flash 

30 falloff in addition to lens falloff may by compensated for by a stronger mask (i.e. a 
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mask generated by using a smaller value for the focal length than one would 
normally use.) 

Toyoda and Yamasaki describe in U.S. Patent 5,461,440 
(incorporated herein by reference) a method of recording a camera identification 
5 code onto the film upon which an image is captured. This identification code 
specifies lens information that may be used at the time the image is processed to 
select an appropriate level of falloff compensation. However, it is not always 
practical or possible to record such information onto photographic film. 
Additionally, many scene dependent factors affect the apparent level of light 

10 falloff present in a scene, including exposure level (extremely underexposed 
scenes never appear to contain falloff), flash condition, and scene geometry. 

Gallagher and Gindele (in U.S. Patent Application Serial Number 
09/293,197, incorporated herein by reference) describe a variety of other methods 
of selecting the parameter used to generate the falloff compensation mask. For 

1 5 example, in this conventional teaching the parameter could be selected in order to 
simulate the level of falloff compensation that is naturally performed by the lens 
of the optical printer. Additionally, the parameter could be determined 
interactively by an operator using a graphical user interface (GUI) or, the 
parameter could be dependent upon the film format (APS or SUC) or the sensor 

20 size. Finally, they teach a simple automatic method of determining the parameter. 
A selected set of low resolution frames are averaged to generate an analysis frame. 
A cos 4 surface model is fit to this analysis frame. This value of the parameter f 
used to fit the cos 4 model to the analysis frame is determined to be the value of the 
parameter f for generating the falloff compensation mask for the selected set of 

25 images. However, with such a system, an image of a person with a white shirt 
standing in front of a gray wall would be interpreted as a great deal of falloff 
because the image would have darker edges relative to the image center. 



Problems to be Solved by the Invention 
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There are a number of problems with conventional systems that 



compensate for light falloff in images. For example, most conventional systems 
require that the focal length of the device taking the picture must remain with the 
image to perform falloff correction. In addition, conventional systems cannot 
5 compensate for image discontinuities. Instead, with conventional systems, such 
discontinuities are often interpreted as dramatic light falloff. Compensation for 
such discontinuities distorts the image in the picture without necessarily correcting 
for light falloff. Thus, there exists a need to reliably and automatically determine 
a level of light falloff present in an image so that the falloff may be compensated. 



The present invention operates upon a single image or a collection 
of images from a common capture device. Each image is processed to derive a 
measure of the falloff present in the image. First, each image is checked to ensure 

15 that the image is not severely underexposed to the point where light falloff would 
not be detectable or correctable in the image. Next, the image is processed to 
remove the components of texture and image structure from the image signal. A 
fitting is performed to determine the best fit between a falloff model and the result 
of the image processing steps. The results of these fittings are combined to 

20 determine an overall level of falloff for a digital image. 

More specifically, the invention comprises an image processing 
system that includes an image collector and a light falloff correction system. The 
light falloff correction system comprises a polar transformer that converts an 
image into radial traces and a falloff fitter that fits the radial traces to a model of 

25 falloff to determine a light falloff correction for the image. 

The system may also include a discontinuity remover that removes 
discontinuities from the radial traces, wherein the falloff fitter fits the adjusted 
radial traces to the model of falloff to determine the light falloff correction for the 
image. The discontinuity remover includes a differentiator that determines an 

30 estimate of derivatives of the radial traces, a derivative adjuster that adjusts the 



10 



SUMMARY OF THE INVENTION 
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derivatives and produces adjusted derivatives that are within minimum and 
maximum derivative bounds, and an integrator that produces the adjusted radial 
traces from the adjusted derivatives. 

The system may also include an underexposure checker that 
5 prevents underexposed images from being processed by the polar transformer, a 
falloff mask generator that generates a correction mask for the image based on the 
light falloff correction, a grouper that combines fit values used by the falloff fitter 
to fit the radial traces to the model, a weighting unit that weights the fit values, or 
a flash fire detector that determines whether the image was obtained with a flash 

10 depending upon the light falloff correction. The polar transformer can produce the 
radial traces from a group of images and the falloff fitter can then determine a 
single light falloff correction for the group of images. 

The invention also encompasses a method of performing light 
falloff correction of an image that includes converting an image into radial traces 

15 and fitting the radial traces to a model of falloff to determine the light falloff 
correction for the image. 

The method may also include removing discontinuities from the 
radial traces, wherein the fitting comprises fitting the adjusted radial traces to the 
model of falloff to determine the light falloff correction for the image. The 

20 removing process includes estimating derivatives of the radial traces, adjusting the 
derivatives to produce adjusted derivatives that are within minimum and 
maximum derivative bounds, and integrating the adjusted derivatives to produce 
the adjusted radial traces. 

The method may also prevent underexposed images from being 

25 converted and generates a correction mask for the image based on the light falloff 
correction. The method may also combine fit values used by the falloff fitter to fit 
the radial traces to the model and may weight the fit values. The invention applies 
the light falloff correction to the image. The invention also detects a flash fire 
condition of the image based on an amount of the light falloff correction. The 
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invention is also useful for converting a group of images and producing a single 
light falloff correction for the group of images. 

ADVANTAGES OF THE INVENTION 

5 One advantage of the invention lies in the ability to perform light 

falloff correction without requiring external environmental inputs. In other words, 
the invention performs falloff correction based solely upon the image (or series of 
images). Further, the invention provides a unique feature for eliminating 
discontinuities from the falloff calculation. By eliminating discontinuities, the 
10 accuracy of the falloff correction is greatly enhanced. 



BRIEF DESCRIPTION OF THE DRAWINGS 

The foregoing and other objects, aspects and advantages will be 
better understood from the following detailed description of a preferred 
15 embodiment of the invention with reference to the drawings, in which: 
Fig. 1 is a block diagram of the invention; 
Fig. 2 is an exploded block diagram of the falloff estimator from 



Fig. 1; 
20 from Fig. 2; 
and 



25 



Fig. 3 is an exploded block diagram of the discontinuity remover 
Fig. 4 is a block diagram of another embodiment of the invention; 
Fig. 5 is a chart showing the classification of flash vs. non-flash 



images. 



DETAILED DESCRIPTION OF THE INVENTION 

Referring to Fig. 1, there is illustrated an overview of the present 
invention. One or more analysis images Fi(x f y) are each input to an underexposure 
checker 10. The purpose of the underexposure checker 10 is to determine if the 
30 exposure of the image is such that performing falloff estimation or compensation 
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on such an image would be inappropriate. The underexposure checker 10 will 
block images F(x,y) from becoming inputs to the falloff estimator if the images 
F(x,y) are considered to be "underexposed." 

Fig. 1 shows that image F2(x,y) is deemed "underexposed" and 
5 thus does not enter the falloff estimator 20. Images which are not considered to be 
underexposed by the underexposure checker 10 are input to a falloff estimator 20. 
The operation of the underexposure checker 10 is described in more detail below. 
In a preferred embodiment, the metric of the images Ffe,y) is logarithmic with 
respect to scene exposure. Those skilled in the art will recognize that although one 

10 preferred embodiment is described with image data in a logarithmic metric, 
modifications can easily be made so that the metric of the images is not 
logarithmic. For example, the metric of the images may be linear, in which case 
the light falloff compensation mask will be multiplicative rather than additive as it 
is for logarithmic data. 

15 Generally, if multiple images are input to the falloff estimator 20, 

the images are from a common order of images. For example, the order of images 
may consist of all digitized images originating from the same roll of color 
negative film. As another example, the multiple images Fi(x,y) may be all images 
captured with common flash conditions and also originating from the same roll of 

20 color negative film. 

The collection of images input to the falloff estimator 20 is said to 
be a class of images. In one preferred embodiment, the class of images input to the 
falloff estimator 20 consists of a single image. 

The function of the falloff estimator 20 is to determine the overall 

25 level of light falloff present in the class of images input to the falloff estimator 20. 
Thus, in a preferred embodiment, the function of the falloff estimator 20 is to 
determine the overall level of light falloff present in the single image input to the 
falloff estimator 20 (since the class of input images consists of a single image in 
the preferred embodiment.) 
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The falloff estimator 20 operates by extracting radial traces from 
the class of images input to the falloff estimator 20. As described below, radial 
traces are processed such that the signal variation attributed to noise and image 
signal is removed, leaving a residual signal variation that can be attributed to light 
5 falloff. These processed radial traces are then fit to a model of light falloff. In one 
preferred embodiment, the model of light falloff is based upon the cos 4 thin lens 
falloff model described by many texts on the subject of optics. For example, the 
cos 4 behavior of falloff is described by Klein in Optics, John Wiley & Sons, Inc., 
New York, 1986. 

10 The operation of this model is fully described in U.S. Patent 

Application Serial Number 09/293,197, incorporated herein by reference. The 
operation of the falloff estimator 20 is to determine the value of the optimal falloff 
value f c which best describes the light falloff present in the images input to the 
falloff estimator 20. The output of the falloff estimator 20 is the optimal falloff 

1 5 value f c . 

The optimal falloff value f c is then input to a falloff mask generator 
30. The falloff mask generator 30 generates a light falloff compensation mask in 
order to compensate for the apparent light falloff present in the class of images 
input to the falloff estimator 20. Note that the images Gi(x,y) undergo the falloff 

20 compensation by using the optimal falloff value f c as will be described in more 
detail herein below. The images which will undergo compensation Gi(x,y) 
correspond to the images which are input to the falloff estimator 20. Since only a 
small resolution image is required for the falloff estimator 30 to perform 
effectively, generally each image F((x f y) input to the falloff estimator 20 is a low 

25 resolution version of the corresponding high resolution image Gi(x,y) upon which 
the falloff compensation mask is applied. For example, in the preferred 
embodiment, the images Fi(x,y) have a resolution of 128 pixels by 192 pixels, and 
the images Gi(x,y) have a resolution of 1024 pixels by 1536 pixels. The image 
Fi( x >y) i s generated by performing a sampling operation on the full resolution 

30 image Gi(x,y). However, since the falloff estimator 20 performs effectively for any 



10 



15 



20 



-8- 

resolution of input images, it is a possibility that Fj(x,y) = Gi(x,y). By utilizing a 
lower resolution, and the invention dramatically increases processing speed and 
lowers required hardware overhead. 

The falloff mask generator 30 constructs a light falloff 
compensation mask for the purpose of compensating each high resolution image 
Gi(x,y) for the falloff indicated by the parameter value of f c determined by the 
falloff estimator 20. In one preferred embodiment, the falloff mask generator 30 
constructs a light falloff compensation mask lfcm{x y y) according to the following 
equation: 

lfcm(x,y) = — ^^log 
log 2 

where d is the distance from the (x,y) pixel position to the center of the image and 
cvs is the number of code values per stop of exposure (again assuming that the 
image metric is logarithmic with respect to exposure.) In one preferred 
embodiment, the value of cvs is 300. Typically, the value of /is the focal length of 
the thin lens. U.S. Patent Application Serial No. 09/293,197 explains several 
methods for determining the value of f. For instance, the value of/may be 
selected based on camera type, or selected so that lfcm(x t y) provides a similar light 
falloff compensation to an optical printer. The relationship between the focal 
length / (expressed in pixels) and the value of f c may be given as: 
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where d max is the distance from the (0,0) (or any image corner) position to the 
center of the image in pixels. Assuming that the center of the image is coincident 
with the center of the array of pixels, the distances d and d max are given as: 
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where r is the number of rows and c is the number of pixels of the full resolution 
image Gj(x,y) to which the falloff will be applied. Therefore, the invention 
produces the falloff estimation without having to know the focal length of the 
camera used to obtained the image. Instead, the invention can calculate the focal 
5 length based upon the optimal falloff value f c . This dramatically simplifies the 
process of performing light falloff correction because the only data that is required 
is the image itself and no external environmental data regarding the camera needs 
to be maintained. 

Those skilled in the art will recognize that various other models of 
10 falloff and light falloff compensation masks may be utilized with nearly equal 
success. For example, it would be relatively simple to construct a falloff model 
and a light falloff compensation mask with 2-dimensional polynomial functions. 
However, such deviations from the preferred embodiment should not be 
considered as novel. 

15 As previously mentioned, the output of the falloff mask generator 

is a light falloff compensation mask lfcm(x,y). Because the image data is assumed 
to be logarithmic with respect to the scene exposures, the light falloff 
compensation mask is then additively applied to each of the full resolution images 
Gi( x »y)> as shown in Fig. 1 to form light falloff compensated images Hf(x,y). 

20 Alternatively, the metric of the image data may be linear with respect to the scene 
exposure, in which case the falloff compensation mask would be multiplicatively 
applied to each of the full resolution images Gi(x,y). 

Referring to Fig. 1, the aforementioned underexposure checker 10 
classifies images as "underexposed" or "non-underexposed." Underexposed 

25 images often have significant portion of digital values at or near the minimum 
possible density. Thus, the falloff of a lens has no effect of the values of such 
pixels. Applying falloff compensation to such an image will cause the image 
comers to become unnaturally lighter than neighboring regions of the image. 
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The underexposure checker 10 first calculates the cumulative 



histogram of the input image. The underexposure checker 10 then calculates two 
features: 



5 /2=c 50 -r> min 

where c n indicates the code value which n percent of the pixels values are equal to 
or less than, and D min indicates the minimum possible code value of the signal. In 
one preferred embodiment, D min is typically about 959. Only iff] <t] or iff 2 < t2, 
then the image is classified as "underexposed" and is not input to the falloff 

10 estimator 20. In one preferred embodiment, tj = 0.2 and t2 = 300. Those skilled 
in the art will recognize that the detection of underexposed scenes may be 
accomplished in a multitude a ways and a deviation from this preferred 
embodiment in the underexposure checker 10 should not be considered novel with 
respect to the present invention. 

15 Referring to Fig. 2, therein is shown an exploded view of the falloff 

estimator 20. Note that the falloff estimator 20 is typically operated on only a 
single channel of each digital image. Each digital image consists of one or more 
digital image channels. A digital image consisting of red, green and blue pixel 
values is said to consist of three digital image channels. In one preferred 

20 embodiment, the falloff estimator 20 operates on only the green channel of a 
digital image. However, those skilled in the art will recognize that other digital 
image channels, including digital image channels which are formed by combining 
the original digital image channels can be input to the falloff estimator 20 for 
estimating a level of falloff for the class of images input to the falloff estimator 20. 

25 Note that as an alternative to using the green digital image channel to determine a 
level of falloff, it is also possible to apply the falloff estimator 20 to one or more 
distinct digital image channels and then choose a level of falloff by examining the 
results of the falloff estimates determined by the falloff estimator 20 for each 
distinct digital image channels. 
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The purpose of the falloff estimator 20 is to determine the value of 
the parameter f c for the class Fi(x,y) input to the falloff estimator 20. To this end, 
each image Fi(x,y) input to the falloff estimator 20 undergoes a processing in 
order to extract radial traces from the image. The variation of these processed 
5 radial traces is presumably attributed to light falloff. 

As shown in Figure 2, the analysis image Fi(x,y) is first input to a 
smoother 32. The purpose of the smoother 32 is to perform an edge-preserving 
smoothing of the analysis image. The output of the smoother 32 is an image 
whose modulation is slowly varying, except for the discontinuities of large edges, 

10 which have been preserved. In one preferred embodiment, the 4-pass adaptive 

recursive filter described in US Patent Application Number 09/457,036 is applied 
to the analysis image. Alternatively, those skilled in the art recognize many 
methods of edge-preserving smoothing are available. For example, the sigma 
filter, described by Jong-Sen Lee ("Digital Image Enhancement and Noise 

15 Filtering by Use of Local Statistics", IEEE Transactions on Pattern Recognition 
and Machine Intelligence, Vol. PAMI-2, No. 2, March 1980, incorporated herein 
by reference) may be achieve an adequate edge preserving smoothing. 

The smoothed digital image F s i(x,y) output from the smoother 32 is 
then passed to a polar transformer 34 for converting the smoothed digital image 

20 from a rectangular coordinate system to a polar coordinate system. Such 

transformations are well known in the art. In one preferred embodiment, the polar 
representation of the smoothed digital image has an equal number of rows and 
columns to the original smoothed digital image. Both the smoothed digital image 
F s i(x,y) and the polar digital image Fpj(xp,yp) contain c columns and r rows. In 

25 one preferred embodiment, each row of the polar space represents a certain radial 
distance from the center of the smoothed image, and each column represents an 
angle (with the first column representing 0 degrees.) Each column represents an 
angular increment of 2n/c 9 and each row represents an radial increment of 
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Each (xp, yp) location in polar space has a corresponding (x,y) location in 
rectangular space. This correspondence is described by the following two 
equations: 



c-l y p 4r 2 + c 2 (2m ^ 



X = H COS 

2 2r 



p 



V C J 



4r 2 +c 2 (27DC ^ 



r-1 y p sr +c 

y = v — sin 

2 2r 



K c 



Thus, the polar transformer 34 determines the value of the polar 
digital image Fpi(xp,yp) at a location (x p0f y po ) by first determining the 
corresponding location (x 0 ,y 0 ) in rectangular space. Then the values of the 
smoothed digital image F s i(x,y) nearby the location (x 0 ,y 0 ) are interpolated in 

10 order to determine the value of Fpi(xp 0 ,yp 0 ). Such interpolation is well known in 
the art and will not be further discussed. Note that the location in rectangular 
coordinates (x,y) corresponding to the location in the polar coordinates (xp f yp) will 
sometimes fall outside of the bounds of the image. In this case, the value of 
Fpi(xp, yp) is set to a constant, for instance 0. 

1 5 The polar digital image F p i(xp,yp) has the following 

characteristics. The top (0 th ) row of the polar digital image consists of a constant 
code value equal to the pixel value of the central pixel of the smoothed digital 
image, which is in rectangular coordinates. Each column of the polar digital image 
corresponds to a radial trace from the center of the image out to the image edge. 

20 Thus, the polar image essentially consists of c radial traces t(n) where n ranges 

from 0 to r-1 of the smoothed digital image from the center out to the image edge. 
The length / of the radial trace (for example, column y p ) is the smallest value of xp 
for which the corresponding location (x,y) in rectangular coordinates falls outside 
of the boundary of the smoothed digital image. Thus, radial traces corresponding 

25 to angles from the image center to a corner of the smoothed digital image have the 
longest length /. 

Next, the radial traces are input to the discontinuity remover 36. 
The purpose of the discontinuity remover 36 is to remove large image edges 
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caused by highly different object reflectances or illumination. A discontinuity is 
considered to be any pixel to pixel variation along a radial trace that is too great to 
be caused by light falloff alone. Note that this definition of discontinuity will be 
dependent upon the position along the radial trace. Also, the number of 
discontinuities is recorded for determination of a smoothness value P. The value 
of P is equal to the length of the radial trace / minus the number of discontinuities 
in the radial trace. 

A radial trace is represented by t(n) where the value of t(0) is the 
same as the value of the pixel in the center of the smoothed digital image. Fig. 3 
shows an exploded block diagram of the discontinuity remover 36. Each radial 
trace t(n) is first passed to a differentiator 50 for the purpose of determining an 
estimate d{ri) of the derivative of the radial trace. 

The differentiator 50 determines the estimate of d(n) by the 
following equation: 

d(n) = t(n)-t(n-\) 

where t is the original radial trace, d is the derivative estimate of the original radial 
trace, and n ranges from 0 to r-1. 

Each estimate d(n) of the derivative of the radial trace is then 
passed to the derivative adjuster 52. The derivative adjuster 52 compares d(n) with 
upper and lower (d max (n) and d m i n (n) 9 respectively) derivative bounds. Any 
value of the estimate d(n) falling outside of these bounds is adjusted. The output 
of the derivative adjuster 52 is the adjusted derivative estimate d\ri). 

The falloff bounds u max (ri) and u m i n (n) are calculated with the 
following equations: 



w maxO) = - — -cvs log 
log 2 



W min( W )=l - CVS log 

log 2 
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where cvs is the number of code values per stop of exposure (in one preferred 
embodiment this value is 300) and g is the upper limit of light falloff and h is the 
lower limit of light falloff. The values of g and h (given as the maximum and 
minimum expected levels of light falloff in stops of falloff from the center of the 
5 image to a corner of the image) may vary depending on the source of the digital 
images. For example the values of g and h may be different for images originating 
from a 35 mm camera or from an APS camera. In one preferred embodiment, The 
value of g is preferably 0.35 for images originating from a 35 mm camera and 0.6 
otherwise. The value of h is preferably 4.0. 
10 The derivative bounds d max {n) and d m i n (n) are calculated with the 

following equations: 

dmaxin) = u m i n (n) - "/m/i(*-l) 
dmax( n ) = u max(n) ~ %ax(«-l) 

Next, the derivative adjuster 52 examines the derivative d{ri) for 
15 discontinuities. A discontinuous point occurs when either of the following two 
conditions is met: 

d(n 0 ) > d min (n 0 ) 
d(n Q ) < d max (n 0 ) 

In one preferred embodiment, when a discontinuous point at n Q is 
20 encountered, the value of the adjusted derivative estimate d\n Q ) is set equal to a 
weighted sum of the previous three values, by the equation: 

d\n Q ) = 0Ad\n o -\) + 03d\n o -2) + 03d\n o -Z) 
If no discontinuity occurs at n Qy then the value of d\n Q ) is determined by the 
equation: 
25 <F(n 0 ) = d(n 0 ) 

The adjusted derivative estimate d\n Q ) is then passed to the 
integrator 54 in order to reconstruct a radial trace. The output of the integrator 54 
is an adjusted radial trace tR(n). The integrator 54 performs the following 
operation in order to determine the adjusted derivative estimate: 
30 t R (n) = d\n) + t R (n-\) 
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where n ranges from 1 to r, tjt is the adjusted radial trace which has no 
discontinuities, and tji(0) = *(0). Note that the adjusted radial trace should be 
monotonically decreasing. 

Each adjusted radial trace tgfji) is input to a falloff fitter 38. The 
5 purpose of the falloff fitter 38 is to fit a predetermined model of falloff to the 
adjusted radial trace. In one preferred embodiment, the predetermined model of 
falloff is a model consisting of a single parameter over which the fitting occurs. 
However, those skilled in the art will recognize that any appropriate model may be 
used. In one preferred embodiment, the falloff model is represented by the 
10 function w(n): 



w(n) = — — cvs log 
log2 



cos 



n 

cos 

r-l 



10 



where cvs is the number of code values per stop of exposure ( in one preferred 
embodiment this is 300),^ is the parameter over which the fit will occur to 
describe the falloff of the adjusted radial trace, and Cj is an offset term. The units 

15 of the variable ft is in stops of falloff between the corner of the digital image and 
the center of the digital image. 

Any technique commonly used to fit a model to data may be used 
to determine the optimal value of ft* by fitting the model w(n) to the adjusted 
radial trace tjt(n). In the preferred embodiment, the chosen f provides for the 

20 optimal fit by minimizing the squared difference between w{n) and tR(ri). Such 
techniques of fitting are commonly known in the art and will not be further 
discussed. 

The fit ft* for each radial trace is then input to the fit grouper 40 in 
order to combine the multiple estimates of a level of falloff and determine an 
25 overall estimate for the level of falloff over the entire class f c of digital images 
input to the falloff estimator 20. 

In an additional embodiment, data 39 corresponding to each fit ft* 
can be input to the fit grouper 40. This data will herein be referred to as "helper 
data 39" and helps weight the different fits f of the different radial traces. For 
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example, the Mean Squared Error (MSE), denoted herein as E, between w(n) 
(evaluated with f = ft*) and tR(n)) can be input to the fit grouper 40. Additionally, 
the length / of the radial trace corresponding to each fit ft* can be input to the fit 
grouper 40. Also, the aforementioned smoothness value P can also be input to the 
5 fit grouper 40. 

In one preferred embodiment, the fit grouper 40 places more 
weight on those fits ft* whose corresponding helper data indicates that more 
importance is warranted. For example, in the preferred embodiment, only those 
fits ft* whose length / is among the top JCVo of lengths are considered. In one 
10 preferred embodiment, X= 70. (Those skilled in the art will recognize that 

processing time may be saved by not processing the shortest (100-X)% of the 
radial traces.) 

In the preferred embodiment, the class fit f c is determined by 
calculating a weighted average of all fits ft* corresponding to the radial traces 
15 whose length / is among the longest JCVo of radial traces. The calculation of a 
weighted average is well known in the art. A weight Wused in the weighted 
averaging process is placed upon each of the fits ft*. 

For example, the weight fFcan be determined by the following 

equation: 
20 W=aQ+$S 

Where Q relates to the radial trace quality and is given as Q = log(P+l), and 5 
relates to the quality of fit and is given as: 

5 = 1- tanh 

The constants a and p can be determined empirically (e.g., 0.084 
25 and 1 .535, respectively in this example). 

As an alternative embodiment, the class fit f c may be determined 
by averaging all of the fits ft* corresponding to the radial traces whose length / is 
among the longest X% of radial traces. 
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As a further alternative embodiment, the class fit f c may be 
determined by averaging all fits ft*. 

Thus, the invention performs light falloff correction without 
requiring external environmental inputs. In other words, the invention performs 
5 falloff correction based solely upon the image (or series of images). Further, the 
invention eliminates discontinuities from the falloff calculation, which greatly 
enhances the accuracy of the falloff correction. 

In a further embodiment of the present invention, the flash 
condition of an image may be determined by the output of the falloff estimator 20. 

10 Fig. 4 illustrates a single image F(x y y) which is passed to the underexposure 

checker 10. Assuming that the image F(x,y) is not considered underexposed by the 
underexposure checker 10, the image F(x t y) is passed to the falloff estimator 20, 
whose function and operation has herein above been described. The output of the 
falloff estimator 20 is the class fit f c . In the case of Fig. 4, the class consists of a 

1 5 single image F(x,y) . 

The value of the class fit f c may be used to determine the flash 
condition of an image by the flash fire detector 60. The purpose of the flash fire 
detector 60 is to determine whether the camera's flash was fired during the 
photographing process of the image F(x t y). The flash fire detector 60 utilizes the 

20 class falloff fit f c (e.g., the amount of light falloff) to determine whether the image 
was obtained during the presence of a flash. In general, images captured with flash 
exhibit a greater degree of falloff (and therefore a higher value of f c .) Fig. 5 
illustrates this fact by showing the value of f c for 133 images. 

In the graph shown in Figure 5, those images which were captured 

25 with the flash are represented with the symbol 'x' and those images which were 
captured without the flash are represented with the symbol 'o\ If the value of f c is 
greater than T 19 then the flash fire detector 60 determines that the camera flash was 
fired when the photograph F(x,y) was captured. Alternatively, if the value off c is 
less than T„ then the flash fire detector 60 determines that the camera flash was 

30 not fired when the photograph F(x,y) was taken. Note that although the flash fire 
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detector 60 is illustrated with a single input from the falloff estimator 20, with the 
invention, the flash fire detector 60 may receive other information either directly 
from the camera or information derived from the digital image as an aid to detect 
the flash fire condition of the image F(x t y). In one exemplary embodiment, the 
value of T, is 0.85. As a testament to the effectiveness of the inventive flash fire 
detector 60, when the value of T, is 0.85, the flash condition of 93 out of 133 
(70%) images was correctly identified. Out of these 133 images, 62 (47%) were 
flash images and 71 (53%) were not flash images. Thus, the flash fire detector 60 
effectively determines the flash condition of an image. 

As shown above, the invention provides the ability to perform light 
falloff correction without requiring external environmental inputs. In other words, 
the invention performs falloff correction based solely upon the image (or series of 
images). Further, the invention provides a unique feature for eliminating 
discontinuities from the falloff calculation. By eliminating discontinuities, the 
accuracy of the falloff correction is greatly enhanced. 

The invention has been described in detail with particular reference 
to certain preferred embodiments thereof, but it will be understood that variations 
and modifications can be effected within the spirit and scope of the invention. 
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PARTS LIST 



Item 


Description 


10 


underexposure checker 


20 


falloff estimator 


30 


falloff mask generator 


32 


smoother 


34 


polar transformer 


36 


discontinuity remover 


38 


falloff fitter 


39 


Helper Data 


40 


fit grouper 


50 


differentiator 


52 


derivative adjuster 


54 


integrator 


60 


flash fire detector 



